MODEL INTERPRETATION AND EXPLAINABILITY Towards Creating Transparency in Prediction Models

Explainable AI (XAI) has a counterpart in analytical modeling which we refer to as model explainability. We tackle the issue of model explainability in the context of prediction models. We analyze a dataset of loans from a credit card company and apply three stages: execute and compare four different prediction methods, apply the best known explainability techniques in the current literature to the model training sets to identify feature importance (FI) (static case), and finally to cross-check whether the FI set holds up under “what if” prediction scenarios for continuous and categorical variables (dynamic case). We found inconsistency in FI identification between the static and dynamic cases. We summarize the “state of the art” in model explainability and suggest further research to advance the field

Unified Explanations in Machine Learning Models: A Perturbation Approach

A high-velocity paradigm shift towards Explainable Artificial Intelligence (XAI) has emerged in recent years. Highly complex Machine Learning (ML) models have flourished in many tasks of intelligence, and the questions have started to shift away from traditional metrics of validity towards something deeper: What is this model telling me about my data, and how is it arriving at these conclusions? Previous work has uncovered predictive models generating explanations contrasting domain experts, or excessively exploiting bias in data that renders a model useless in highly-regulated settings. These inconsistencies between XAI and modeling techniques can have the undesirable effect of casting doubt upon the efficacy of these explainability approaches. To address these problems, we propose a systematic, perturbation-based analysis against a popular, model-agnostic method in XAI, SHapley Additive exPlanations (Shap). We devise algorithms to generate relative feature importance in settings of dynamic inference amongst a suite of popular machine learning and deep learning methods, and metrics that allow us to quantify how well explanations generated under the static case hold. We propose a taxonomy for feature importance methodology, measure alignment, and observe quantifiable similarity amongst explanation models across several datasets

Antiplatelet therapy with aspirin, clopidogrel, and dipyridamole versus clopidogrel alone or aspirin and dipyridamole in patients with acute cerebral ischaemia (TARDIS): a randomised, open-label, phase 3 superiority trial

Background: Intensive antiplatelet therapy with three agents might be more effective than guideline treatment for preventing recurrent events in patients with acute cerebral ischaemia. We aimed to compare the safety and efficacy of intensive antiplatelet therapy (combined aspirin, clopidogrel, and dipyridamole) with that of guideline-based antiplatelet therapy. Methods: We did an international, prospective, randomised, open-label, blinded-endpoint trial in adult participants with ischaemic stroke or transient ischaemic attack (TIA) within 48 h of onset. Participants were assigned in a 1:1 ratio using computer randomisation to receive loading doses and then 30 days of intensive antiplatelet therapy (combined aspirin 75 mg, clopidogrel 75 mg, and dipyridamole 200 mg twice daily) or guideline-based therapy (comprising either clopidogrel alone or combined aspirin and dipyridamole). Randomisation was stratified by country and index event, and minimised with prognostic baseline factors, medication use, time to randomisation, stroke-related factors, and thrombolysis. The ordinal primary outcome was the combined incidence and severity of any recurrent stroke (ischaemic or haemorrhagic; assessed using the modified Rankin Scale) or TIA within 90 days, as assessed by central telephone follow-up with masking to treatment assignment, and analysed by intention to treat. This trial is registered with the ISRCTN registry, number ISRCTN47823388. Findings: 3096 participants (1556 in the intensive antiplatelet therapy group, 1540 in the guideline antiplatelet therapy group) were recruited from 106 hospitals in four countries between April 7, 2009, and March 18, 2016. The trial was stopped early on the recommendation of the data monitoring committee. The incidence and severity of recurrent stroke or TIA did not differ between intensive and guideline therapy (93 [6%] participants vs 105 [7%]; adjusted common odds ratio [cOR] 0·90, 95% CI 0·67–1·20, p=0·47). By contrast, intensive antiplatelet therapy was associated with more, and more severe, bleeding (adjusted cOR 2·54, 95% CI 2·05–3·16, p<0·0001). Interpretation: Among patients with recent cerebral ischaemia, intensive antiplatelet therapy did not reduce the incidence and severity of recurrent stroke or TIA, but did significantly increase the risk of major bleeding. Triple antiplatelet therapy should not be used in routine clinical practice

Antiplatelet therapy with aspirin, clopidogrel, and dipyridamole versus clopidogrel alone or aspirin and dipyridamole in patients with acute cerebral ischaemia (TARDIS): a randomised, open-label, phase 3 superiority trial

Background: Intensive antiplatelet therapy with three agents might be more effective than guideline treatment for preventing recurrent events in patients with acute cerebral ischaemia. We aimed to compare the safety and efficacy of intensive antiplatelet therapy (combined aspirin, clopidogrel, and dipyridamole) with that of guideline-based antiplatelet therapy.Methods: We did an international, prospective, randomised, open-label, blinded-endpoint trial in adult participants with ischaemic stroke or transient ischaemic attack (TIA) within 48 h of onset. Participants were assigned in a 1:1 ratio using computer randomisation to receive loading doses and then 30 days of intensive antiplatelet therapy (combined aspirin 75 mg, clopidogrel 75 mg, and dipyridamole 200 mg twice daily) or guideline-based therapy (comprising either clopidogrel alone or combined aspirin and dipyridamole). Randomisation was stratified by country and index event, and minimised with prognostic baseline factors, medication use, time to randomisation, stroke-related factors, and thrombolysis. The ordinal primary outcome was the combined incidence and severity of any recurrent stroke (ischaemic or haemorrhagic; assessed using the modified Rankin Scale) or TIA within 90 days, as assessed by central telephone follow-up with masking to treatment assignment, and analysed by intention to treat. This trial is registered with the ISRCTN registry, number ISRCTN47823388.Findings: 3096 participants (1556 in the intensive antiplatelet therapy group, 1540 in the guideline antiplatelet therapy group) were recruited from 106 hospitals in four countries between April 7, 2009, and March 18, 2016. The trial was stopped early on the recommendation of the data monitoring committee. The incidence and severity of recurrent stroke or TIA did not differ between intensive and guideline therapy (93 [6%] participants vs 105 [7%]; adjusted common odds ratio [cOR] 0·90, 95% CI 0·67–1·20, p=0·47). By contrast, intensive antiplatelet therapy was associated with more, and more severe, bleeding (adjusted cOR 2·54, 95% CI 2·05–3·16,